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Thi^ paper describes the results of a behavioral analysiVryf learning . 
sequences used in initial instruction in tKTNev, Reading Syst|m (NRS),' 
an early reading curriculum. A rational analysis using behavioral caie 
jories yielded a set of strategies fo> teaching, feading jcquisifio, skiUs 
Contingency management was assessed by an applicatioii of the blackout 
\technique. Errors on progress chec,ks were related to the content and 
design of the learning sequences. The results of the analysis p'rovide 
data f6r thV evaluation of the instructional products.' The method us'ea 
for Ae analysis has general application to the assessment of other 
instructional products. — • , " 
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This paper presents Ae resets of an analysis of selected products 
of a structured curriculuifi in early reading. The purpose of the study ' 
was to provide one kind of formative evaluation of particular instructic^al 
sequences in the New Primary Grades Reading System (^RSJ; {Beck-& 
*Mitroff, 1972). The analysis showed what was being taught ani liow it 
was being taught. The main emphasis, however, was on how reading 
acquisition sldlls J^re taught in NRS. Hence, the entire thrust of the 
study was to make explicit the particular instructional strajegitfs that 
were operative within the analyzed curriculum products. It is through * 
the instructional strategy that learning theory enters the classroom. A 
major purpose of.this paper has bepn to show the extent to which princi- 
ples derived from learning theory have been incorporated into the planned 
learning sequences of NRS. ' - 

\ ^ 

To further clariiy thfe focus of the study, it may be helpful to say 
what it is not. It is aot an analysis of^reading -content or subject matter. 
It i^-n9t an analysis of mature or even skilled rtfading b'ehavior. It ie an 
^alyste of a particular instructional approach (that embodied in the NRS 
curriculum products) for teaching reading acquisition skills to yo'ung chil- 
dren of kindergar*ten or first-grade age level. " 
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The content o£ this study is a set of instructional* strategies de- 
rived from the overall* strategy or des^ign ot NRS curriculum products. 
These strategies are described and discussed under headings £rom the 
Skinner -Holland basic learning cycle (Holland & Do'ran, 1973). The / 
strategies found' m NRS have a generjalizable usage. Making them ex- 
plicit within the context of a specific reading acqutsition curriculum 
shows, to a greater extent than cursory examination of th^ materials 
permits, how and why the prog^ram works. It also provides specific 
examples for others who would instruct in reading acquisition skills. 

. This paper will first give a generaM overview of the I^RS curricu- 
lum. Hiis includes a listing of tEe instructional components or products 
available* to teacher and/or student. In additioi^. the organ^ational 
stnictyre of the materials is briefly described. Than, the specrific 
products which ^are the subject of thijS analysis are identified; As part 
^f-.the general overview, the limitations of a Skinner -Holjand 'approach 
,to curriculum analysis are discussed.. The design of the study is ex- 
* plained briefly. -. * , • 

The second section of this paper presents the basic findings of the 
analysis^ *Th»se are strategies of instruction. They are presented 
under headings whicK roughly coincide with the Skinnerian leaVning cycle 
(Skinner.. stimulus control, situdent responses, promoting mem- 

o-ry, evaluation of responses, and contingency management. The final 
section of thi-a paper presents somfe conclusicyis leased on the findings 
and some implications derived frorn^ this particular type of studV. ^ 

General Overview 
Description of the Curriculum - - 

The N?w Primary Grades Reading' System^NRS) is an experimen- 
tal reading ac^isijion program produced at the "Learning ilesearch and 
Development Cente^ of tbe University of Pittsburgh.* The rationale and 
design ot- the curriculum have been presented in another paper (Beck & 



. ^ , :.MUroff. 1972). Th^ instructionaT components of NRS consist o'f the 
following: a teac_h'er'sv manual for each level; cassette' tapes for each 
. ^ lesson, a wor4cbo*ok for each le^el or par^of a level; blending'bopklets. 
^ ^'letter cards^^and pocket-charts: storybooks, tests, games, and manipu- 
lables. and. finally, alternative teaching strategies.,. One of the.uniqu;- 
-features of NRSls the^sign of the system, -with each compb^ent" 
containing specified content and skills that are related to and integrated 
with bther components along the continuum of instruction. Figure 1 " - 
highlights the essential features of NRS. , 

The general approach to reading m NRS is a code*breaking 'one. 
Decoding oi- word attack skills a^e specifically taught, if a word has not " 
*yet become a part of the child's recognition vocabul^^y,^ th/wo7d may 
be attacked m its separat^etter parts and so decoded. ^ 

Wtthtn NRS. there ar^e four strand^ or pa^^rns of^^progression. 
' Tn^ee of these--the decoding strand, the comprehension strand, and 
the, self ^managtment stprand-^-move in a' kind of intertwining sequence. 
The fourth strand, that of alternative strategies, is available for chil- 
dren who capnot respond sOccessfuiry^ in the planned progression of " ^ 
lessons and re^^ws. ,^5^ ^ 

The curriculum is organized into'app^roximately !6 levels. The 
, first two levels contain 25 teacher-ledUssons. Each^le'vel thereafter 
f contains aSoj^O cassette-led lessons. Within i»ach level, there i^P^^ 
vision -for (J^th hb^fizo^al and vertical movemem. The vertical rnbvi 
rt^eni is turned the prescriptive category (she -T/gure 2). The hori^n- 
tal movement included number of stor^ books^. games, and ma^la- 
bles thatVl)^ cjiild is encouraged but not required th try. 
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This study cent^r^-on'th^ instructional sequence (hat /oiiipnse s 
the^vertic^ progression oi the cJ'rriculum as this is/senTortly in th^ 
linfear set of behavioral objectives embodic^in/ea^pn'^que^^^ Jlie 
segment of interest i^s the vcrtica^^ progressjion '^d t*^ initiaJ^instruc- 
uon withm this firogrossion h.e. , rhe first ti/ie a-^rtJ^ular t'ype of 
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Figure 7. Flowchart of the mstryptional sequence qf NRS {From Beck & Mitroff, 197?.') 

■ ■ ' ■ ' -8 



learning is introduced). Workbook pages are studied only as follow-up 
arfd maintenance of skills that were taught in initial instruction. (5ee 
bracketed section labeled Analysis m Figure 2. ) The-materials analyzed 
are the scripts for teacher-led* lessons, response sheets with tape 
scripts Tor cassette-l^d lessons, a^d workbook follow-up pages. 

Limitations of the Analysis 

/i ' ^ f / ^ * 

The, limitations of a Skinner -Holland approach (Holland k Doran, 

1973) to curriculum analysis are basically the same as those of a more 
V . 

general Skinnerian approach (Skinner, 1953) to behavior. Within the ; . 

t r 

Skinner -Holland model, instruction is viewed as essentially a manage- 
ment process: The task is to control the conditions of learning by 
^applying the basic learning principle* This principle can be stated 
thus: Arrange for the learjiertio make the appropriate response sc^ 
that it can be reinforced. Analysis, according to this model, calls for 
the identification of the three terms of the contingency (viz. , the stimu- 
lus, the response,, .and the reinforcement).^ This three-term contingency 
or operant then becomes the repeatable unit to be used in the construc- 
tion of replif able sequences of curriculum. The analysis is thus lilted 
to a clear identification of stimuli, responses, and contingencies for 
reinforcement of critical responses. Fu^hefmore, only curriculum 
products thaf* have adhered to^this Skinne'rian design, at least implicitly, 
should be subjected to thi§ kind of analysis. 

Both the design and the analysis of the design are based on the 

assumption that laboratory vafiables can be translated into the class- 

room setting and still retain enough validity to facilitate learning artd to 

oper^lionalize thf^rinciples of learning theory, rThis same assumption 

require s"ar least -acmne degree. of indfvidualization in the. design of the 

curriculum loatcrials. 

*' * ■* * » " 

Anoth«r*as sumption of this approach to the design and analysis of 
curricula is that learning is the product of the cqnsequen^es of behavior.^ 
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Related to th.s .s the contention that errors are punishing and 'should.' 
.. therefore, he minimized .in^he plan of Instruction, ijrror rales do, 

howev'er. .'.ve data on^ert stu;ient responses. In accordance with ' 

these assumptions, th.s type of curriculum analysis will place er^pha-'' 
, sis on the contingeocies buxltlnto the program. The analysis will also 

consider daja'on student errors as giving access to inlormatiin on s„tu- 
. dent learning.- jy^e mode of correction of errors also merits attention" 

in the analysis. 

F.nally, t«fe type pf analysis used' in'this' study assumes t^,at there 
.3 a def.nite "body^of knowledge" to be org^,.ed. In this way, instruc 
tipn can be objective, precise, a^d efficient.'^ The rate of learning for 
individuals .s,maximized. While this analysis does 'not deaUwUh the 
^ issue of mcyvidual student rates, it does extract from the materials a 
* structure of the skills of reading acquisition. ' - 

• A basic limitation of the Skinner -Holland approach to the analysis 
of^ curricula is that no use .s made of cognitive models of rearning.\ The 
work on meaningful Verbal learning or in psycholinguistics, memor-y, 
and perception cannot be tftijized. Know«lge Is equated with behavior 
and there^is no attempt made to describe eveats in the conceptual sys-" 
t^m^The variables studied are limited to programming variables-- 
that .3. input or stimuli, outpit or responses, and straightforward rela- 
tionships betwe^rvand amJngAhese. Tl,e Skinner -Holland method con- 
centrates on shaping behavior by'a gVaduaj progression and successive 
approximations, prompting and fading of prorripts, and acHve responding 
as evidenc<^of prj)per discriminative behavior. These <ton^titute the ' 
conditioi;^ of learning. 

r 

Design of the Study ^ ^ 

I 

The study is designed on the assumption that 7nherent in the ' ' 
materials of NRS is a prescriptive theory of instruction for reading' 
acquisition. In constructing the components of a curriculum according 

4 
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to a predetermined^ plan, there are at least Fcmr elements to be con- 
sidered: .(a) the structure of ^he skill to be Required (the basic tasks 
of reading acquisition)/ (b) the entry behavior the learner, (c) the 
instruc^onal procedures, and (d) assessment of mastery behavior 
•(Glaser, 1976). In identifying the structure of r^adir^ acquisition 
skills as they appear in NRS - tKe>erarchy for decoding produced by 
^Gagne (1965) serves as a model.- The reading acquisition mq^ls re-^ 
ported in the Targeted Research and Deyeiopment Project on Reading 
(Willian^s, I^^^also serve as aids to identify the small tasks <if read- 
ing acquisitio^nrNRS. ^ ' ^ . 

- The task analysis fdr NRS ha/been divide^! into two parts: 
xlecodin^ tasks and comprehension tasks (see Figure 3): EntryU^eKav- 
4or of the learner Has been identUied^as the language skills possessed. ^ 
by a 5-^ or Vyear-bld child. T^e typis of tasks designed for the instruc- 
tional sequences m^ake some assumptions ^boiit the skiLU the child ^ 
already hAs and those he ixeeds to be taught. This study has accepted 
those assuhiption;5. v ^ ^ ^ ^ * • 

At the end of the study, some discussion is given to the results 
of the^progress checks. T?is is not a statistical or quantitative meas- - 
'ure of results. It is descriptive and its puf pose is to point out 'the ^ 
degree oi success H^ieved ^y the learners using the.mode^of assess- 
ment buVlt into the design of th^e material'^* 

l /ain emoha^sis . The main omphasis of this study J^/^J^Tte third 
essential el^ement for an instructional ^<^ign^ the instructional proce- 
dures oV strategic^, "^he prescriptive principles or instructional strate- 
gies Tdentified Are those derived from the Skinner-Holland learning 
model; -These are strategies related ta-stimuli, strategies related to^^ 
, student response, and' strategies for' contingency manag^jment, including 
» sequencing. . ^ ^ 

Selection of curriculum comp6nent8 . Curriculum materiM^ to 
be analyzed were selected only from the vertical progression (i.e. , ^ 



DECODING^ <graphenrnc unrts)^ ^ ^ • . 

• 1 Produte the sound that corresponds to the stimulus: a smgle letter' 

a digraph, a blend, a diphthong ^ 

2. Identify^raphertiic units by 50und^ ; 

3. Discrimirjpte.graphenrnc units by sound 

4. Dtscrinnnate sqelling patterns bs graphemic units ' ' ' • 

5 Blend sounds intb words . ' 

6 Identify words' by sound ' ' * ' 

• 7 Discrimfnate words by sight . » ^ ' 
^ 8. piscrimmate vanousi units presenTed sitjultaneously 

9. discriminate thefgfevanl graphemic stimulus * , . 
1P Gener^ize among graphemic uoils 
#v 

COyVfP/?£H£/VS/0/V (words and word groups) ' ^-^ , 

1 Label- identify words by picture; transfer ijDeanmg from'picture 
Jo'word > - • 

2, Identify units of meaning by* sight: words, phrases^ntences, \ ' 
paragraphs * T ' . , ' 

3. Discriminate various units of meaning *- » 

4 Generalize unitj of 'meaning: by sound to units of meaning by ^^R*' 

5 Retat^ or^l language patterns and printed -s^ructi^l groupings • * 

/ ' . 

Elementary comprehe/^sion is on th? level of SVntax and surface structure 
of language. . 

The structure of the discipline of- reading is^a set of relationshit)s between 
spoken and written language.* * 



Figure 3. Task frtalysis for NRS. \ 
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either teacher-led or ca^setfe-led lessons; ^ee Fi^pife. 2). From the'se 
le«aons were selected only those where'a stTafegy was employed for the 
first time ojt wh^re new content required either new strategies or itera- 
tions in strategies- already employed. I^ure 4 givts art outline o!f the ' 
decoding materials in-teTms.of curriculum content. Figuxe 5 shows 
the Specific letter- sou^d Correspondences in order of introduction into 
the program. These materials Jorm what the designer has termed tljs^ ^ 
deQQding strand of NRS/ * - , ^ , ♦ 

. • In the ,analy:/is of the compre'hension strand of-NRS, selection o,f 
materials was limited to: ,(^) a single le^sori from the ^vorkbook follow* 
ufS-pageai (b) 'compreh^ns ion form'at types on first occurrence, and 
(c) fOO randomly. s^elected workbook pages, '^he single -less on *analy sis ^ 
showed strategics for^facilitating independent xoj;nprehension immedi- 
ately following instruction. Study of the various comprfeheijsion formats 
showed how both v§iriety and gradual p;rogre88ion in difficulty ^^ere jUi- 
tcorporabed into the- curriculum. Selection; of 100 worl^book pages was 
intended to give a more- general itidication of the degr^ee of attention to 
text that the materials of KRS required from the learner, - 

Procedure.6 of analysis' . Once the i^iateria^ had been selected 
and organized as curriculum products, each se^xhent was* then analyzed 
in detail. / Four^/'escriptive elements wex*e identified in each instruc- 
tional sequence ^™wze^: \{3l) entry b|^yior» (b) ma^stery behavior (the 
reading acquis itiWHtsk), (c) instructi^^ procedure, and (d) assess-^ 
ment of mastery.^ The third element, .instructional procedure (strate- 
^gies), received intensive analysis for eacli segment. The Skinner-*^ 
^'Hoiiajid model ^Holland Doran^i 197^) was applied to the procedural 
$/lemebt of each segment of the curtiCulum selected for analVsie. In 
this way, strategies rejated to stimulus, to response, and to sequencing 
were made explicit. , ; 

' The materials already selectedjn accordance with criteria base^ 
on curriculum organization were'/urther cat^^J^zed by the SkinAer^ 



Emphasis pn Decoding Behavior 



Textual 
Objective 

•Read 
regular ' 
words 



Levels 



Content and^or 
Process 



Instructional 
Product 



1 llsynfibol/" 
sound 

cofr^espondeoces 
2, algorithm ^ 



Letter/sound 
correspondence 
in Basic 
Script f1 

Blending in 
Basic Script 
n2, ^3, and #4 



Read 

fegulaV ' 

words. 
" Sight 

words, 
^ phrases. 
"'Sentences 



3 -sy/nbol/sound 
generalization 
for andaa 

4 Fading the 
* algorithm 



y Portion of 
Lesson ^, 
Lctvel ih 

Basic Scripts 
^3, and #4, 



Read , 
spelling 
patterns 
{larger * 
chunks) 



III - ' 



5. symbol/sound 
cprresp6ndence 
ch ^ 



6. et. It. ejc. 
spelUng 
patterns 



Presentation 
"format and 
' script for 

cassette-led 

Lesson 3-1 -A 
< \ }^ — 

Lesson 3-4-A 



Read 

long 

and 

short 

Vowels 

words * 



%. long and short 
vowels^ viz., ' 
/ Fading 
diacritical 
marks 



Cassmte-led 
Lesson 6-2~A 



— a 1 — , 

^' ""'"''^ '"''^''^ ^^^"^ ''''^^'^ progression of programmed 

objectives Emphasis on decoding behavior. 9 k a cu 



11 



14 



Level t 


Lev^i til 


Level IV 


, level^V 


Level VI 


1 a.m.s.t.c 


1 ch 


1 d,0 


1 V 


, 1-wh 


2 - , 


2 0 


2 u 


2es * 


2r 


Z - 


3 1 " 


3 - 


3 th 


3 y/funny 


4 ~ 


4 patterns 
' et. Jt, ot. 


4 k 


' 4ar , 


4 - 




ap, jp, op 










5 - 


5 - 


5 y/try 


5-- 


6 n 


6 r 


6 - 


6 - 


6j 




7 - 


7 - alt 


7 6 


J ay. a» 


8 - 


8g ' . \ 


8 w 


8 er, ur. t? 


8x 


9e ^ 
10 - 


9h 
.10 - 


9 1 

10 - • 


-9 u 
l6^ 


' 9 patterns 
10" 


11 b 


11 - 


1 1 - 






12 5,^ ' 


(61 




(5) (5) 


(4) 



Level H . . - , . 

1 S. T, M ^ '1 Placement of^b#and d at a distance 

* 2 c, M, N • -^^ - 2. introduction of p but not q 

•3 ' *3. Placement of f and v at a distance ^^-^ 

* 4 " 4. Placement i^/S correspondence 1n 

^ Levels!, and 2/in Level li ^J-r'^ , 
; 5 - " , ' ^5. Oniy;6 or 6 per 10 or 11 Messons^-- 

— ^-^ ^ . ' . ' 6 Alternate stogie L/S correspondence 

with digraphs, blends, diphthongs 
or patterns 

7 f 7 Does not introduce aii vowels at 

once, or all short or at! long 
-r^K^ J _. - -woweis at onc^. ■ ^ 

8 ee, ea n ^ ^ * 

9 - Note, Numbers in parentheses indicate 

10 i , ^ new tfitter,/sound correspondences 

1 1 - - ' " - included at each level. 

12 ^ " " ^ ^ ' 



13 ss. ff. tt, ing \ - , 
* 14 p . ^ 

15 patterns xa ; 



SEQUENCING OF NEW INSTRUCTIONAL STIMULI PRESCRIPTIVE 



^J-^Fjfur'e, 5. Sequence of^^nboi/sound correspondences for Levels t VI in NRS. 



Holland model acco^din^^ to response'types. This categorizat^n is • 

shown in Figure 6. It was used to group the materials of the deciding 

strand of NRS. Re^onSes for comprehension were categorized into 

two types: word scanning and textual scanning. Com'^>arisoffs^<vvere 

made with s'everaJ'comprehension taxonomies (Auerbach, 1971 Gfarroll- 
cv * , " - ^* " * 

1972. Davis, 1968; Reading Objectives. 1970). A tasi< analysis of NRS 

i ' ^ - hi 

was given in Figure 3. . - • 

• ' * ^ ,\ _ ' 

The^pplication of the Skinner-Holland model to the analysis of 

instructional Procedures implies that the rriterials have been struc'^ 

tured or programmed. Certain principles of learning theory have been 

applied.. The Variables derived from that *eory shbuld h^ve assumed 

f(5^n« ^importance m th^desfg^fof the materials. 

* A programming vatiable is tha^ aspect pf a learning sequence 
that may be deliberately manipulatecj by the designer. The recogni- 
tion of the yse and function of progi^amrining variabjes is what gives ^ 
elegance to^the desig^i of mstructioL The Skinner -Holland model 
places emphasis upofe the Stimulus^ the response, and ,|he reinf or<:fe-, 
ment. Within this context, these programming variables iveie of ^ 
interest: (a) eliciting and maintaining attention, (b) prompting, 
(c) response availability, (d) fac/htation or interference m memory, 
(e) mediation techniques, (f) page and format layouts, and (g) the use ^ 
of two channels Jor stimulus ihput. ' These particular variables a're." 
generalizable across a variety of cont|^. In this analysis, they were 
examined with reference to reading o^^^ent structured fo;- acquisition 
skills. ^ ' '**^^>s^ ^ 

• The results of^the analysis are' of three kinds, rirst are the / 
strates^ies or principles of instruction for reading acquisitiol^. These 
are derived frorr>a rational analyses ^f both content and process fo^ 
reading as these show forth in fhq^instructionat materials. The second 
IS a SJ^dy of attention to text in NRS'as determmerj by an application - 



/ 



Establishing Ajniroi by a new 9timulus*^a pwniecTgrapheme for 
a spoken sound , '* . 

Analysis of Basic Script =1, 

Establishing a new response pattern (repertoire) joining strings of 
graphemic units to form words t ' * 
Analysis of Basic Scripts -2, -3, andV^ 

Establishmg rpte associations • . 

In this case, learning sight word% » ' ' ' 

AnalysiSLof appropriate Lessons of Level II 

Establishing stimulus generalization- 
Making the sam6 response to different graphemic stimuli , . ^ ^ 
Analysts of the^teacher led pprtion of Lesson 8: Level II 

J 

Es't abiding anr abst^^on 

cOpcep^formation, recognition of ail instances of a class. 
Generalizing across Levels of NpS through previously , 
analyzed sequences (see Figure 4)> ^ . v 



Figure 6. Types of tasks to bje studied fn NRS 
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of the blackout technique. The Jthird is a stucfy of the materials in the 
light of student errors on progress checks. * \ / 

While all three typesr^of- results in tKis are /^ecific to read- 
ing, the procedures used have more genera/appLation to other content 
areas. According to the nature of the discipline/ the same general 
process could be adopted. What fpllo^s is a brief reporting of the 
results of this study. A more detailed t?ea.tix^enf appears in a doctoral 
dissertation, by Mj^ormick (l^tS).^' ^ 

Results of the Analysis 
Instructiohal Strategic s^l^ NRS^ ^ ' - 

Structure. The analysis of this>ro|rarm indic'ateV that the struc- 

t^ryof the discipline of Z^arniHg to read i^ a set of relationships (cor- ' 

respond^ncfes) between printed textual nnits and spoken la^ittge pat- 

terns. The^size of the unit of processing is treated as variables 
< 

feature. The unit for decoding may^vary from a single letter' to^a 
sj^filling pattern of three or four letters. The unit for^ comprehension 
may be as small as a aingle word or as large as an enj^re sentence. 
By presenting the elements for decoding both in isolation and in con- 
text, the program teaches^that there^^ no one single urTit either for ^, 
decoding or for comprehension. By consistent variatipn of the use of 
the«e units either^n insolation or in context, the learner is taught this 

• essential concept.^which forms the basis for learning-to-read skills: 
*^'viJ^ "^^st deal with a variety of graphemic and syntactic units in 

, order to read^ well'. " , 

The'b&sic reading acquisition task is -the transfer from the use 
of exclusively auditory symbols for language compr ehensfon to the use 
of visual symbols of language for comprehension of. the same message. 
In the acquisitidn- stages'/ the reacJi>»igr of words must be accompanied 
by the hearing of ^o^. The concep't of a word is taught by induction ' 
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when the key phrase. "'The word is * completes the procedures 

of the blendidt: algorithm, , OjktfWifif:, in the Algorithm., some steps needed 



earlv m the process later. All of tliis is characteristic 

oi the teacliing oCi^^^^^^hW^ ior reading in NRS. 

Mastery beharvlor^ .^^astery blhavior is stated in terms of 
Carroll's U%'i) definition of readlnfe'i "the perception and comprehen- 
sion of written messages m a m^Sinrier paralleling t\\^ oTthe correspcmd- 
ing spoken messages'Mp. 336)^_;^^astery behavi^^ a rejat^e 

term. Within the first six level^o^^RSTmastery behavior for^ecod- 
» mg consis^ of'the unprom^feOpplicatioryof the, skills^cQiftaine«Lin the_ 
blinding algorithm. Comjjrih/niion majexy includes the use <5f a recog 
niliion voca^ularyN^^in^e ^ontext bf^ariQu\^types of syntacfi^ patterns 

/ - Entry Ijehaylc^ , Upon^^^ring the New ^Rea^g System (NRS), 

\thQ"'i^rner is^pr^sumeX^o h&^e th0 j^rti^ular skflls associated with 
^.y^omSi^etence m oral language at age'^i^vp or six. He is not presumed to ^ 
ri-4iavV the ability to writfe./ ^reov>r7^any reading acquisition task ^har 
^J.V .the qhild is exp^ct^d to perform mdep„an<ieTitly is first presented m in- 
" |truction. Amorfg types^of tasks taught -in the deccyding strand of.NRS 
is the segmentation of words into their cQmponent parts. Tliis'is ah 
important reading skiH that c^nnot^e presumed to be a part of the 
learner's entering behavior. Tbe use of imitation (modeling) in NRS 
takes advantage of the skills" ali^eady in the learner's repertoire. 

Sequencing s As the Ifesso^is progress, units (*asks)^that were 
pnce quite drstinct become grouped into larger units^ ™s is a princi- 
pTcrunning through the' entire program. Its applicatio/ is evldeiit Jioth 
m the selection of stimuli for presentation to the learner and in the 
types of responses that'arc shrape^ successively throughput tile 
sequ ences 
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strategies Related tc/th e..s'kionex.- Holland Model 

•Stimuli. Wdiscriminatiye .stimuli for the decoding strand'lre 
. graphemic units of various sizes' (see Figure i). Tor comprehension, 
the,discriminati/e stimuli are words art>d various Syntactic patterns. 
Questions are v/stfd in NRS to focus .the attention o^ the learner on spe- 
.■ cific syntacti/ patterns. Th^ observing and instructional sU«,uli used 
- in modeling /re already in the learner's behavioral repertoire. These 
stimuli aid the learner in discriminating the new graphemic stimulus, 
which is th^.object of th^ instructional s;q«ence.. In NRS, ample use 
IS made of this strategy. ' * ^ 

• ba.ic strat£^ for the selection of graphemic stiWuli in NR^' 

y to present to the leasner only those units that do follow the alpha- 
' betic principle. Thfs keeps consistency high. However, inconsistf ncie 

are also introduced^as early as fcvel I so as to alert the 'learne'r-to the 

fact that they do exi'st, ' 

Discrimination of stim.,!^; Various strategies are employed for 
the presentation of st'imuli^_ In e^rlyJearning,. stimulus- pairin"g is us^d. 
-n>e oral stimulus is paired^vith th'e graphemic represelitation and thus 
the learrrer is guided to give th^ same response to a new stimulus. Also 
in the beginning, a g<-o^ stimulus control is established. This is dons 
by.presenting the graphemic unit in isolation. Once the learner can 
identify the discriminative stimulus (S^), cont/ol is'sharpened by pre- 
senting the in.varioifs contexts. Another strategy for sharpening; 
stimulus control matching to sample. This-is ah easier task than 
■ presenting w^rds contain^g the S^ al^one or where, the occurs ii, 
varying parts of the word. _ T^iese same techniques' are appli.ed ih tKe 
presentation of syntactic units. 

' *' ^ 

Thfi use of cirrtrast i» employed as i strategy in NRS. The - " 
-teacher (voice on^the tape) pronounces words (e.g.^ W mat'e) before 
asking ^the child to read them!' Another strategy employed in NRS is 
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the inrfoduction of new elements without explicit instruction. For 1 
example, the size the type is gradually made smaller but no a^tten-^- 
tion is drawn to it. • ^ * " 

* Examination of the 'response page« shows that generally there Is 
^pattern ol easy to diffitult. .The progression is f^om gross discrimi- 
natron to sharper discrimmation. Exceptions to these general prpte-* 
-du-res seem to occur £o/^% salj:e of relief f'rom a steady stream of dif- 
ficult and attention -demanding tasks. 

« ^ A 

< StiU another techniquf for stimulus presentation is the combina- 
tion of previously learned graphemes into spelling patterns! New and 
larger units to rmed of-femiliar stimuli are created. Th\l"s, varied 
examples of the.concept of graphemic unit -are provided. 

Sup porting stimuli . In a^ditiin to the S^. tfie object of the mstruc- 
tipn in the learning sequence, there are numerous suppsning stimuli. 
The function of these varied prompts is to direct the attentio/l of tft^ _ ^ 
^liil^nertTtFe'^and to eAble him to^produee the correct response. 
Basically, proiT>pts are either formal or thematic. Formal prompts 
provide information about the form of ati ex^^cted respo~nse. In NRS, 
the response format itself/nerves as a formal prompt. In addition, 
within the response formats these'exaxjRples of formal prompts occur: 
(a) showing part. of a word for completion, (b) use of rhym^es, and 
(c) the underlining of relevant graphemes,' The yoice on ^e tape^can . 
also deliver formal prompts, patticularl^n^the fofm of rhymes. The- 
► matic prompts depend on meaningful associations^to make U morejikely 
that the student will give the expected responses, fhese^occur in NRS 
especially through the use 6^ pictures and al^o thoough verbal elabora« ^ 
tions that the voice, on the tape gives^out words, ^ In particular, the 
prompts are faded consistently through*Hes^n ^equ^^es" and also 
through the lessons of a level,^ and final-responses are unprompted and 
independent^ » - " m 



, . ReVponsas in NRS. ' Written respon-sek: though limited to mark- 
ings of various types, should be indications tTiat,some covert response 
has already occurred. Responding in NRS/must be Quite frequent. The 
.• -workb^k pages, whirh follow up the instruction of the teacher or cas- 
sette t^. perform the function of^rov^ding rehearsal of new skills 
taught in initial instruction. . ' . , ' 

<:ritical respons es, ly,^ critit^ response" must be identified for 
,„ every learning sequence. It is only upon the occurrence of'thfs response 
,and its- consequent reinforcement that learning can, be guaranteed 
(Holland. 1965). the (beginnj^ 'of reading in^truc4n for decoding, 
the learner actually knows' the :^sponses he needs t^Joduce. . What 
he needs to Wrn is how and when to use these responses. The strai.- 
• gi^^s used to elicit these known responses in NRS are. verbalinstruchons 
«nd-demonsrrar,oT,of,hrdesi?ea response. "Once"a]fw relationship is 
learned. ,( must be practiced In a variety^f contexts kd reviewed peri- 
odically. ' , . * 

V ■ . ■ . 

AnotH?"- strategy used in NRS is derived'from the /act'that there 
are classes of responses of which 4 single response may be ^ne mem- 
ber. This is important for the shaping of correct phoneme Responses. 
An approximation close'enough^to the sound modeled by the teacher 
should be accepted as a correct r^fsponse because.it is a ^mimber oUh. 
g^neraUclass. -Oiis printiiSle al^o takes into account the variations in 
inflection in different parts of the country and the existence of dialects 
of English. Accepting erresponsf a| a member of a class of appropri- 
ate responses is an i^JJ^tant functicfn of the instruction. 

The strategies for eliciting'thiT critical decoding responses are: ^ 
(a) maljing successive approximations, (b) shaping the response's by 'dif- 
ferential reinforcement and by gradually raising the criterion-ol accept-, 
•able behavVdr'.' and finaHy (a) fading prompts until the rtspojise is pro- ' 
duced inaependentjy. WiO, re,ererftfe\o responses, the dcsiSsn^must indi- 
cate no. only the specific .-csponse but also the circumst,||ces undfr 
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^whfch It js to be eh<;ited.»as well as when there is to be a change from 
one type of response to another. For exaiTi||^e, in NB,S there is a shift 
m the letter/sound sequence; from arv-imitative^audit6ry response to a- 
response to a i»rAphemjc stimulus. 

Acquisition of associaUons i The fundamental inferred response 
^throughout the decoding str^ind is the si?li^le'ass^ociation.* The number 
of associations to be learned at one time must be limited, and easily 
. confused associations should be kept at a distance. The curriculum con- 
' tent shown in Figure 4 i^j^icates that this is so. Particularly notable is 
the placement of b in Level I and of d in a level beyond Level VL Also 
noteworthy is the intro<iuction of only one sound for a .^i^en ^raphetm- at 
a time, the u^^|fcgiacritical marks as a distinguishing characteristic 
for vowels tha^^J^ otherwise look alike., and the careful sequencing 
to remove th/diac i^tical marks^n later lessons. All of these measures 
serve to prevent confusion of &sso.ciations.^ ^ ^ 

T^e acquisition of new associations is -also prompted by efforts to 
employ previously learned associations in the learner's repertoire. An 
example of this is th^ introduotion in Level I of a digraph (an important 
graphemic concept), which has a very faifiiliar and, it seems, attractive- 
sound for children: /sh/. In the comprehension strand, the voice on 
"the tape often elaborates about a new word, using familiar associations 
in order tq facilitate memory of the word. ^ 

In order to demonstrate the acquisition of an association, the 
learner must make more than a copying response. In NRS, responses 
are required that-^mply a discrimination of the Stimulus. Sounds pro- 
duced eaMr^n the learning sequence by mere imitation are later required 
to be produced both independently and when the corresponding grapheme 
is presented m any order of^ccur rence. * ^ 

Discrimi nati ons and generalizations . Dtscriminations should be 
prompted, practiced, and introduced with contrast\ In auditory dis* 
crimination, imitaiion (as in the blendini^ algorithm) is the learner*s 
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way of showing that he has detected the distinctive fektures of the 
response. Simple generalizations on the part of the learner, can, bV 
facU^ated b'y requiring the same response to different stimuH, A 
paorc subtle generalization in learning' to read is the production a 
unj^tte sound upon the presentation of a graphemic tin'it of whoever 
sizfe. Ws'type of geflef^ization is caUed for throughout ^he cassette 
tape legions. -Th^ same type^of'generalization must be made in decbd- 
ing the v^iou's examples of syntactic units. This occurs more fre- 
^ qufenUy in^the workbook pages. Demonstratibn by decoding correcUy > 
is the rtjeans of determining whether' the learner has acquired the con- 
eept. Rftesentin^ de^^g and compreheiT^idn units in context (e.g. , 
^n »^stofii€s'') eftabies tfie^earner to use negative information. NegaUve 
• '^^^'T^.^'^^.i'^'^e context of concept formation means the irrelevant • 
featu/e^and negative examples o5 the corfcept. A section of continuous 
prose compete the reader ta'generalize vS^th reference to tSe concepts 
of grj^mic unit and syntactic unit by introducing features' irrelevant* 
to these concepts for any specific unit he has sfelerted for decoding. ' ' 

In^ddition to concept formation, the program provides for, con/ 
cept'utUization by limiting vocabulary mosifly to wordfe Urpdy familiar 
to the child. The algorithm provides the chUd with a set things to do , 
to solve & pr6blem. It also calls on sldUs alre^ay poiTscssed by the 
learner but shows a new way of coroMning^these skiui.' _ - 

Promoting memory. Still another class of strategies in'NRS are 
those that promote memory. Placing highly similar stimuU at a dis- 
tance, limiting the size of a lis£ to be learned, and providing for prac- 
tice immediately after instruction a/e'some of the ways used iii NRS to 
'.facilitate memory. Others are immediate reinforcement for correct 
responses and verbal instructions usei so consistenUy that tliey may 
become self-prompts for the learner, > Efforts to keep errors to a mini-, 
mum and to build a large recogniHon vocabulary indicate attention to ' 
facilitation of memory. 
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A number of strategies already mentioned have relevance for 
facilitation of memory^ Rehearsal is known to be an important modifier 
' of rate^of learning an'd degree of retention (Glaser, 1969). The workbook 
pages provide rehear^l and thus serve the retrieval stages m memory. 
The length of t|ie span of immediate memory increases when the material 
is familiar and has be6n m some way organized by previous learrting 
(Gagne, 1970). This same principle is'applied in the blending algorithm* 
Since about 30% of the variance in coi^seixension achievement can be due ^ 
to memory for word L^wng (Davis, 1968), using words whose meaning 
18 alreadV famih^o most 5- or 6-year-olds is an important strategy. 
Finally, the recodmg provided by the incorpoication o'f old responses into' 
new should facilitate memory. Once material is recoded, it may resist 
competition very strong'ly (Deese, 1958). Contrast in discrimination 
learning helps to overcome the effects of interferen<re (GagYie, 1970)» 

'^". Evaluation of l-e8pon3e3 .~~^^ three-ferm TiopHngency i« mear^t the 7^ 
relationship between the stimulus,* the response/ and the reinforcement* 
This relationship should be planned in such a way that the reinforcement 
IS dependent or contingent upon the production of the correct response 
./fo-the stimulus _pre8ented* Reinforcement should .al way s have reference 
• to the specific befcavior to be acquired. 

To complete the three-term Contingency, once a response ^as been 
emitted, some decision must be made a^^io.its correctness* The re- 
sponse.must be "sensed" or evaluated. TTie ideal way to ^o this is on 
a one-to-one basis between teacher and student. However, since this 
is not possible in th? typical school situation, the teacher must be very 
aware of the possibility of interference from the wrong responses of 
other^Kildren in the group. -Earl^ learning-requires more continuous ^ 
- reinforcement than later learning, as ili the early sequences of NR&.- 
The critical final^indcpendcnt response for eacJi sequence is an indi- 
vldual Response within the group instruction. 
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j When cassette-led instruttion is used", provision must be made 

fpr the immediate evaluation to be self-evaluation. In cassette-le^ 
instrupfioti, responses K:an only be^corrected or confirmed. The pro- 
gram shoi^ld be very effective provided that tht learner's difficulties * ^ 
have been anticipated and Hie voice on the tape can give*the kind of ^ 
-feedback that the learner needs. Only eorlpirical vali4ation can assure 
that this i^ 50. The rational analysis sRowed that great attention had 
been given to the strategy of providing appropriate feedback to the * 
' ' learner on the tape. ^ 

: . ^ / 

Use of reinforcement. As learning progresses, intermittent 
reinforcemfent will suffice to keep the learner moving through a 
sequence. Not evei^ ansyr^J need be confirmed and/or praised. One 
^ technique in sequencing is to try to end with both independent and cor- 
. re9t^responses.' However, evaluation or ^'sensing" of the learner's 
"response is thie weakest part of the design of NRS. 

^ Reijifbrc^men^ tends to be a rather indivjdualistic^matjter. How- 
- e^^r, ift designing instruction, it is possible to generalize £b some 
degr^ concerning thelcinds of things a particular group of'leamers 
might fii;id reinforcing. ^Types of reinforcement generally used through- 
out th6 program are as follows: artistic and pleasing arrangements'' 
of pages, (b) immediate feedback or knowledge of results, and <cj^the 
p<^ssibility for a high level of success. dej>ending on how well the bro- 
gram estimates what the learner can do. Small steps areireinforced. 
• T^ie learner can control his own behavior by turning the t/pe recorder 
on and off and deciding howlong to stay qn a particular frame. The 
program makes use ofj'silly" sentences, joke?, riddles', puzzles, etc,.* 
The movement from frame to frame and from workbook ttf workbook 
can be reinforcing. , t » , * 

In suipmary. the progitm is not highly responsive to the errors 
of the individual. Individualizafion i4 achieved Jjy g encfralizing about 
the capabilities of learners of this age who^have nb previous training 
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in rfcading skill's.' Individuali2fation depends also to a great extent on 
tie teacher's judgment and the teacher »s ability to*fit the program to ^ 
the learnej'. Examinatii>n-of individual students J progress through the# 
levels^ of MRS indicated that, except A variations in initial^tarting 
points in*the prograA'not much varilmon was eviSen^ed the routes^ 
through the prescribed- lessons. N^me learners did^ of course, skip Z 
review sequencer. -Managen^ent tar individualization^ccurred gen- 
erally at the progress checks., Ideally, this kind of evaluation could 
happen all tl\r,oiigh the sequences. The materials in therfiselves are 
not responsive to individual errbrs of ^e lear^r. The nature' of the'' 
program makes it imperative that teachers h^ve very specific tr^j^^ 



in evaluating the range of acceptable oral decoding responses within 
the.early sequences. 

Contingency Management 

An overall analysis of the program can be made in- terms of con- 
tingency managements Generally, the individual sequences as well as 
the cumulative sequences have been planned in such a way that, given 
the presentation of the appropriate stimulus, thV.correct response is , 
elicited and then /ein?orced. Generally, 'reinforcement iff in the form 
of feedback, which, if all has gone as plann.ed, tells the learner that 
he is correct.' .What the feedback really tells is the correct response, 
and then it conditionally off-ecs*^ raise to the learner U he has responded 
'with the correct answer. 

' 'in NRS, contingencies are first ^stabjjshed for small '^steps. " 
Active and specifted responses'are detailed in^the letter-sound sequence 
Later some stepAare faded and^this sequence itseU is incprpotated into 
the blending algorfthm. Th«n soirfe of ^e^e stepsAre fa<fcd. Hius, a 
^ind of pattern is established. ' \ * 

* * s ' . » * * 

If the learner oart merely^guess, the contingencies have not been 
planned properly. ^In the letter- sound sequenpe, tl^ere are two possible 
* / : • ' . " ' ^ . • * 
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interferences with the proper se,q^encing of contingencies. -One ia the 
possibility ofthe learnel- not responding" correctly and yet being rein- 
forced by the teacher who failed to detect his wrohg response because 
of-group answering* Another confounding of contingencies could occur 
if the child was not ready to move from the mouthing cue to the finger 
cue. He could still be looking at^<I^ache r^^ s mouth ^hen should be 
looking at the finger pointing ty^ie let\r, which has now beea 'removed 
from in front of the teacher's face and held at arm's length. This can- 
be av.oided if.the' teachef is careful in making the transition fyotii cue 
to cue, and-U s/he is careful to adminftter cues in such a way that.the 
learner does not become distracte^ and so fail'to look at the letter 
whose sound is Ijeing cued. '''>■., 

In good instruction, interesting things should happen after the \ 
student has read a page or lis^4ned or loo)ced with care (SkiWr, 196?). ■ 
When this does occur, the materials are really self -pacing. Sime of 
the management strategies in NRS^ssume that reading behavior will . 
become-SeU-reinforcing. This,is the rationale behind the gradual 
withdrawal-^f exter*n^l rewards liRe praise; especially on the cassettes. - 
-• • ' , ■ • » 

In planning for contingency management, not only must the criti- ' 

cal response be identified, but also the other responses lekdifig up to 
the p^-oducfion of the critical response. Moreover, _con6isten<5y of 
demands makes it easier for the learner to sense ;he contingencies. ^ 
Ufa decoding sequences, the cotxting^ii^^could^^-^r^^ 'to the' v - 
learner thus: If you, cqr^iyWate this sound and then use it to ' 
identify the correct grapheme far graphemic unit, you will be rewarded 
(praised). Pointing, looking, and saying musto^cur simultaB^sly. 
This is in order to fulfill the condition of continuity'fo'r forming the* 
association. In the comprehen8ion_sequences, grammar^ rules deter- 
mine the contingencies for the successful demonstration of knowledge 
'of the syntax of the language. If the learner is Vraise'd only for the ^ 
predetermined behavior,. then the contingency wiU be es'tablfshed and 



the Consequent reward should increase the probability^ o£ correct 
re-spondmg in the future. For the most part, thi^ is the }^ind of plan- 
ning^ that IS evidenced in the materials of NRS. 

Blackout technique. Analysis of the contingent relationships built 
into the instructional materials was made by using the blackout technique » 
(Holland, 1967). This is a method'for measuring the extent to which 
the response's in a self-irfstructional program are dependent on the con-* 
tent (inferred responses) of the program. The blackout "ratio" is the 
percentage of the program that caa be dereted without tnfluencing error 
rate. Research with the blackout technique has indicated that making 
overt responses facilitates learning, provided that these responses 
are contingent upon the critical content^ pf the lesson (Holland, 1967). 
By critical content is meant one or more tasks identified in the task 
analysis. In a well-d«signed lesson, the student can respond correctly 
when and only when his responses demonstrate thaJjie has made the 
critical inferred response to the stimuli presented in the lesson. In 
other words, the learner should make the right response for the right 



reason. .« 



^ - The r6quirenj^nt for overt responses should provide a way of 
monttoring the /overt responses. In order to mark the 2:orrect word 
or 'picture, the learner must have had^to read all or almosfall of the 
^ords in a given format (frame). In the blackout technique, the <frord 
is taken as the unit df analysis. In the completion of each^r^bie, the 
•fearner should be able to pr^d^ce~the correct response by reading the 
' text, the overall task should, be one identifiedln the task analysis 
(e.g. . identifying phrases within the context of a sentence), 

In-thls jstudy of NRS, ^the blackout technique was^pplled to two 
different Bejis o^ workbook'selections. First, ^efacfh new response for- 
mat wa-s selected at its first-occurrence/ The blackout ratio for these 



frapfes (rather than full pages, which Sometimefl included several^ 
fi^es) was estimated by a single judge. Of the 32 fr'ames thtis 
selected, 16 were judged to have no blackout at all. This i^eani that 
all of the texThad to be read by the student in order' to respond as 
specified. The- remaining frames had blackout ratios ranging from 3% 
to 66+%. If the purpose of *he fraipe at first occurrence is simply to 
accustom the learner to a certain mode of_ response, then possibly a^ 
higher blackoMt could be t^oierated. However^ if the intent is to^ave, 
the student read every word of the text, then.s^me reWsion of piges , ^ 

with' high blackout ratios is necessary/ It should be noted that the * 
ratio reported here is simply a judgme-^it of one rater. No attempt 

was made in this analysis* to validate the judgment with other raters.' * 
' No attempt was made to ascertain whether the designer had p^osely^ 

introduced frame^TWith a high blackout ratio at particular places. 



Progress Checks * * * ^ 

' A iow blackout raHo indicates that the mat^ial is well programmed 
^ provided that the error rate is low. Ass^ming that critical content is 
being programmed; the errors of students can ttien be aJSi^zed to see 
What elements of content presented the greatest difficulty. Such diffi- ^ 
culty could indicate that perhaps the functional units for the program 
are too small for (he learners. Lack of errors could also indicate that 
the learners ^ave nrjastered the critical Content through valid instruc- . 
tional techniques. 'Oncfe low error rate has'been established, Vu/ther ^ 
analysis is necessary to determine what the low error rkte means for ^ 
the learners. « ' • 

* I. y ^ 

Data on errors from the progress checka do no't prGKide the saine 
kind of informatioft/ as data on errors from^ arf application of.^e\l^l 
out technique. In order to provide blackout ratio inforpiatio'n, errors 
made on the instructional ^sequences themselves \vould have»^ be tabu- 
lated an<i analyzed aftei- tfje manner-used by Hpliand" (1967). Tli^ err'or 
'0- ^ 
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data from the progress checks simply ^show how many learners retained 
an acceptable number (as judged by the desig-ner) of letter - sound dis- 
criminations, words, and syntactic patterns at the end of a level or 
. lesson in NRS. ^ , - , 

The sample for which this information^^is reported consisted of 
four classrooms with a total of 74 children, all in Grade 1, Eacli class- 
room had a different teacher. The data consist of eriW^^n progress 

' .jfc ^ • ^ , 

\ *X checks for each of the^Levels I through VI of NRS. 'There is one prog- 
\. ^- * ' 

jt ress check each for the end of Level I and of Level II. Hiereafter, 



there i^a progress ch^ck for each lesson within each leyel and errors 
*are reported in that manner. 

The analysis of the data from the progress checks showed a high 
level of success for most of th.e learnbrs. Hie greatest number of 
errors occurred where success^Te consonants had to be blended. This 
is 2 difficult skill and some errors sliovdld be expected here. In some 
cases, the errors of only a few children acc^oimted for all of the errorr 
'St a given lesson. Hie fewest errors occurred at the upper levels 
where the most rapid learners were concentrated. 

Aa interesting circumstance to note is that* even with the materials 
ve-ry caref\$lly^trtl'ctUTed, nhe teaohersft ^till made a^'^re^encj^in the 
5Ucce^8^f Aeir atudentsi One teach«j: apparently ti*jHg<3Lt(> ans^Vze the 
orrors^df Her students and ma^e JQP^tionB «jt ^ifiix-^^pg't6^st ch^c3c»> 
Tills same teacher made use of the p^ptnpt *l>i^txd^'^hen children were, 
having difficulty decoding a word. This technique brought success "to 
students who might otherwise have failed. Hie unequal progress of. 
students by^ class room is evident'ln the data displayed in Figures 7 and 
8. Further investigation would be necessary to verify that differences 
in student groups by classroom are related to differences in teachers* 
strategies within the program. _ ^ 

Hie degree of individualization by rate of progress through the 
materials is s^own in Figures 7 and 8. Figure 7 shows the distribjition 
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of students over the levels of NRS at tlie end of Grade 1.. Figure 8 
shows the location of the individual students by lessons within these 
levels. Figure 9 shows the rate pf progress through the levels of NRS 
.for six students selected because of th^e different patterns, they foUowed. 

— — For the task analysis employed in the design of NI^S to be clearly 
shown to be adequate and effective for the instruction of the selected 
5- and 6-year-old population, what is.needed is a validation of fhe task * 
analysis witKiA each lesson sequence. Using a'sm^ number" of stu- 
dents, the blackout technique could be .deternnined by empirical investi-^^ ' ' 
gatxoa^or the acti/al instructional sequence (not t^'e progress checks). 
Froip these results, it could be determinea whether some -of the "steps" ^ 
ar^ too large or-too small for most of the students for whom NRS has 
been designed. ^ f 

Firthcr analysis of less(5in sequences mi^t also be done^to deter- 
mine what maMfrial is redundant for the learners who can progress 
rapidly (viz., those who arrive^ at Lev^l Vm^in June, when this study 
was ^one). Perhaps as the learners spread <i2t-and the concepts of 
gr^phemic unh and of syntactic unit are acqi4red, stiU more variety " ' ^ 
is needed in the types of sequences presentedl^o the learners* ^ITie ' 
size of the-^isteps" could^depend on the s^eed w?th which the learner 
can acquire theee two basic concepts needed to. became '^lf^^l {^-de- 
coding ancf in early comprehensionlasks. * 

A carefully validated empirical anal/sTs should be i^^de^'^lQie-n^ '-^.-^ 7 / 
stelected response formats used in this study knd^also of a sample of - 
randomly Selected workbook pages. In the present rational analysis, ^ 
even though estixpates of tlie degree if blackout were made, more pre- ^ 
cise information is needed. SoAie attention should also be given to the ^ ^ 
mode of; correction of errors within the sequences* Empirical data^ 
would give accurate information on the degree o/ attention to text that 
is required and elicited from learners in NRS. * 
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Figure 8. Distribution of students throughout Le\^efs and Lessons of NRS 
at the end of Grade % itine 1, 1974. 
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^ • ^ Conclusions 



It is through the instructional strategy that learning-theory entery 
the classroom; Thi^ study demonstrates and makes more" explicit one 
designer's mode ofjntroducing behavioral learning principles into the 
sequences' of a structured curriculum." The analysis mikes evident 
. four main principles of instruction: (a) making expUcit use of knowl- 
edge "kiout the capabilities of the learner for whom the materials have 
been designed, (b) structuring language units so that they ian be readUy 
grasped by the learner, (c) identifying a progression of effective se- 
quence types, and (d) specUying the contingencies of reinforcement. 

TTie greatest contribution of OiU particular curriculum to knowl- 
edge of instruction in reading acquisition is the ca;eful identification ' 
and sequencing of stimuli for lea>ning to read, together with contingen- 
cies th«t focus attention on these stimuli. T^,e greatest weakness of 
NRS lies in the lack of a complete "sensing" unit for%valuating student 
response in a continuous manner, »,e design task analysis. ^ elabo- ' 
rated in the materials, displays a gpod "matc^," with experimental b^^k^ 
analyses describeji in the Uterature of research on reading acquisition. 
Still more precise measures need to 'be applied to the sequences of NRS 
'to indicate the predictabyity of the strategies described. 



Implications of the Study 



Investigations related to curriculum in the past have been directed 
mainly toward understanding the" effects of iilstruction, The focus has ' 
been on the effect of instruction*! conditions on achievement. IWs study, 
instead, looks at the instructional conditions themselves.' The identifi- 
cation of behavioral elements in sequences aUows for comparison with 
like elemejits in 9Xperimental research studies. .This study dUfers from 
experimen-tal research in that it deals with an entire curriculum extend-, 
ing over the course of an entire ^ear.' The study deals with the' instruc- ' 
tional treatment.Ohe design, and production, " J 
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Although the particular curriculum analyzed Sere was a 
ing prograin, ^the method of analysis has general application to 
types of curricula. The main point of tKe analysis is that it i^ 
earned with the qualitative aspects-of the instruction and depends upon 
rational analysis and description to acdomplish its purpose, 
method requires a clear identification of the variables suid the estab- 
lishment of meaningful relationships between them. The structure of 
the discipline being, taught must be, extracted from the materials and , 
in some way compared with the structure as seen by researchers of, 
or in', that discipline. Task's for learning^should relate the content o 
and the process of the skill in such a way that learning is facilitated. 
The results of such an analysis provide data useful evaluating in- 
structional products. The method then has general application to the 
assessment of instructiohal products, especially if fliese products 
have been developed according to principlls that all^ for the pro- 
duction of replicable sequences. As a. technology of instruction 
develops «nd is applied to the design of educational materials, new 
methodologies for assessing these materials will-be needed. The 
analysis performed in this study J's an example of one such methodology. 
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